Target practice on talking faces
نویسندگان
چکیده
A method is described for video-based tracking and analysis of talking heads. Although dots on the face and head are tracked now, clean faces will be tracked once a satisfactory optical flow technique is found. The analysis consists of decomposing the head and face motion components into a common mode and the residual, thus eliminating the need for complex marker tracking and head correction of face motion.
منابع مشابه
Auditory-visual perception of talking faces at birth: a new paradigm
Newborn infants prefer faces to all other visual displays. All previous studies of face recognition in newborns used schematic faces, photographs or static real faces. In our study, we used video films to explore, for the first time, recognition of talking faces, in newborns. Our results suggest that video films of talking faces are very salient stimuli for newborns and can enhance face recogni...
متن کاملYou said that?
We present a method for generating a video of a talking face. The method takes as inputs: (i) still images of the target face, and (ii) an audio speech segment; and outputs a video of the target face lip synched with the audio. The method runs in real time and is applicable to faces and audio not seen at training time. To achieve this we propose an encoder-decoder CNN model that uses a joint em...
متن کاملContributions of a Babyface and a Childlike Voice to Impressions of Moving and Talking Faces
The present research examined if the impact of a babyface on trait impressions documented in previous research holds true for moving faces. It also assessed the relative impact of a babyface and a childlike voice on impressions of talking faces. To achieve these goals, male and female targets' traits as well as their facial and vocal characteristics were rated in one of four information conditi...
متن کاملSearching for a talking face: the effect of degrading the auditory signal.
Previous research (e.g., McGurk & MacDonald, 1976) suggests that faces and voices are bound automatically, but recent evidence suggests that attention is involved in a task of searching for a talking face (Alsius & Soto-Faraco, 2011). We hypothesized that the processing demands of the stimuli may affect the amount of attentional resources required, and investigated what effect degrading the aud...
متن کاملAudio-visual synthesis of talking faces from speech production correlates
This paper presents technical refinements and extensions of our system for correlating audible and visible components of speech behavior and subsequently using those correlates to generate realistic talking faces. Introduction of nonlinear estimation techniques has improved our ability to generate facial motion either from the speech acoustics or from orofacial muscle EMG. Also, preliminary evi...
متن کاملذخیره در منابع من
با ذخیره ی این منبع در منابع من، دسترسی به آن را برای استفاده های بعدی آسان تر کنید
عنوان ژورنال:
دوره شماره
صفحات -
تاریخ انتشار 2004